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REMARKS 

Applicants appreciate the Examiner's thorough consideration provided in 
the present application. Claims 1-10 are currently pending in the instant 
application. Claims 1-10 have been amended. Claims 1, 2 and 3 are 
independent. Reconsideration of the present application is earnestly solicited. 

Priority 

Applicants appreciate the Examiner's indication of acceptance of the 
certified copy of the corresponding priority document for the present 
application. 

Drawings 

Applicants appreciate the Examiner's assistance with respect to the 
drawings. In light of the foregoing amendments to the drawings, Applicants 
submit that these objections have been obviated and/ or rendered moot. 
Specifically, Applicants have amended FIGs. 2-5, 8 and 10 as suggested by the 
Examiner in the Office Action. Six (6) sheets of replacement, formal drawings 
have been provided as an attachment to this Amendment. Accordingly, this 
objection has been obviated and/ or rendered moot. 
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With respect to the Examiner's comments concerning FIG. 2 and the 
alleged step of waiting for the depression of a "REGENERATION BUTTON" 
between steps S100 and S102 on pages 9, lines 18-20, the Examiner has 
misinterpreted this section of the specification. Specifically, FIG. 2 is accurate 
and fully representative of all of the material necessary for a proper 
understanding of the claimed invention. Further, the section of the 
specification referred to by the Examiner in the Office Action is slightly different 
than that paraphrased by the Examiner. 

Specifically, on page 9, lines 18-20 (see paragraphs 0042-0044 of the 
enclosed specification), the Examiner will note that "When half-pressing the 
shutter button which is provided to the input unit 26 at SI 12 "SHUTTER 
HALF-PRESSED", the program proceeds to SI 14 "CAPTURE IMAGE* and waits 
until the shutter button is fully pressed." However, this step is shown in FIG. 
2 and is designated by steps SI 12 and SI 14 in FIG. 2. Please see the various 
flow arrows entering and leaving step SI 12 that show the variety of process 
steps that will take place depending upon the activation of the shutter button. 

With respect to the description of the specification relating to Step S180 
in FIG. 5, Applicants submit that this description is proper. By selecting the 
number (T) of the image(s) a user wishes to display, the user is selecting a 
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particular image. The Examiner's confusion with the operation of the present 
application does not necessitate any further amendments to the drawings, but 
instead is already adequately described in the specification in a manner that 
would be readily understood by one of ordinary skill in the art. Applicants 
request that the Examiner contact the undersigned if any additional issues 
remain with respect to the drawings after entry and consideration of this 
Amendment. 



Specification 

Applicants appreciate the Examiner's assistance with respect to the 
specification. Applicants have incorporated the changes recommended by the 
Examiner. Accordingly, this objection has^b^en rendered moot. However, with 
respect to the term "processes," on page 8, line 22, this term is proper since it 
is the plural form of the term process, e.g., more than one process, as intended 
by Applicants. 

With respect to the Examiner's confusion concerning FIG. 5, the user can 
specify images to be displayed by displaying the corresponding number of the 
image. Therefore, this objection is improper. 
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In accordance with MPEP §608.0 l(q), Applicants herewith submit a 
substitute specification in the above-identified application. Also included is a 
marked-up copy of the original specification that shows the portions of the 
original specification that are being added and deleted. Applicants respectfully 
submit that the substitute specification includes no new matter and that the 
substitute specification includes the same changes as are indicated in the 
marked-up copy of the original specification showing additions and deletions. 

Since the number of amendments that are being made to the original 
specification would render it difficult to consider the case, or to arrange the 
papers for printing or copying, Applicants have voluntarily submitted this 
substitute specification. Accordingly, Applicants respectfully request that the 
substitute specification be entered into the application. 

Claim Rejections Under 35 U.S.C. § 112 

The Examiner has rejected claims 4 and 7-10 under 35 U.S.C. § 112, 
first paragraph as allegedly failing to comply with the written description 
requirement. This rejection is respectfully traversed. 

Applicants have amended claims 4 and 7-10 to clarify the claimed 
invention for the benefit of the Examiner. In light of the foregoing amendments 
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to the claims, Applicants respectfully submit that these rejections have been 
obviated and/ or rendered moot. However, Applicants respectfully submit that 
the foregoing amendments have been made to merely clarify the claimed 
invention. 

Without conceding the propriety of the Examiner's rejections, but merely 
to timely advance the prosecution of the application, Applicants have 
incorporated the changes recommended by the Examiner. However, Applicants 
submit that the requested changes do not appear to either raise a substantial 
question of the patentability of the claimed invention nor do they narrow the 
scope of the claimed invention. 

Claim Rejections Under 35 U.S.C. § 102 

Claim 3 has been rejected under 35 U.S.C. § 102(e) as being anticipated by 
Kobayashi et al. (U.S. Patent Publication No. 2002/0054218). This rejection is 
respectfully traversed. 

In light of the foregoing amendments to the claims, Applicants 
respectfully submit that all of the rejections have been obviated and/ or 
rendered moot. Without conceding the propriety of the Examiner's rejection, 
but merely to expedite the prosecution of the present application, Applicants 
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have amended claim 3 to clarify the invention for the benefit of the Examiner. 
Specifically, Applicants submit that the prior art of record fails to teach or 
suggest each and every limitation of the unique combination of limitations of 
the claimed invention. Accordingly, this rejection should be withdrawn. 

With respect to claim 3, the prior art of record fails to teach or suggest 
the unique combination of limitations of the claimed invention, including the 
feature(s) of: "regenerating non-ambient sound in accordance with audio data 
which is recorded in a first recording medium; recording image data 
representing a subject in a second recording medium at image-capturing, and 
recording, in the second recording medium, audio regeneration data which 
indicates where the non-ambient sound is stored at the image capturing; and 
regenerating an image in accordance with the image data recorded in the 
second recording medium, and regenerating the non-ambient sound at the 
image-capturing in accordance with the audio regeneration data which is 
recorded together with the image data and also in accordance with the audio 
data which is recorded in the first recording medium" (Emphasis Added) 
Accordingly, this rejection should be withdrawn. 

The Examiner has relied upon the Kobayashi et al. reference as allegedly 
being analogous to the claimed invention. However, Applicants submit that 
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Kobayashi et al. only describes the regeneration and recording of "ambient" 
sound associated with an image through a microphone and the eventual 
regeneration of the "ambient" sound through a loudspeaker. Therefore, the 
only sound that appears to be taught or suggested by Kobayashi et al., appears 
to be the recordation and /or regeneration of "ambient" sound directly 
associated with the captured image data. 

In contrast, non-ambient or external sounds stored or pre-recorded on a 
recording medium in the present application are regenerated with an image, 
e.g., such as those in the various tracks of a disc recording medium within the 
audio regeneration device 70 or from the recording medium (element 42 in the 
present application) may be regenerated in conjunction with an image. In 
addition, the claimed invention provides for the recordation of the location 
information, e.g., audio regeneration data that indicates where the non- 
ambient sound is stored at the image capturing, for the non-ambient sound for 
each image. Accordingly, Kobayashi et al. clearly does not teach or suggest the 
limitations of claim 3. 
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Claim Rejections Under 35 U.S.C. § 103 

Claims 1 and 2 have been rejected under 35 U.S.C. § 103(a) as being 
unpatentable over Kobayashi et al. in view of Official Notice. Claims 3-10 have 
been rejected under 35 U.S.C. § 103(a) as being unpatentable over Anderson 
(U.S. Patent No. 5,812,736) in view of Kobayashi et al. Claim 5 has been 
rejected under 35 U.S.C. § 103(a) as being unpatentable over Kobayashi et al. 
in view of Mogamiya et al. (U.S. Patent No. 5,220,433), and further in view of 
Official Notice. Claim 6 has been rejected under 35 U.S.C. § 103(a) as being 
unpatentable over Kobayashi et al. in view of Mogamiya et al., and further in 
view of Ishibe et al. (U.S. Patent No. 5,657,074). These rejections are 
respectfully traversed. 

In light of the foregoing amendments to the claims, Applicants submit 
that the prior art of record fails to teach or suggest each and every limitation of 
the claimed invention. Accordingly, these rejections should be withdrawn. 

With respect to claim 1 , the prior art of record fails to teach or suggest 
the unique combination of limitations of the claimed invention, including the 
feature(s) of: "at least one of an audio regeneration device which regenerates 
non-ambient sound and a communication device which communicates with an 
external device which performs audio regeneration, wherein when the subject 
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image is captured, audio regeneration data which at least indicates where non- 
ambient sound during audio regeneration is stored is recorded in the recording 
medium together with the captured image data and the audio regeneration data 
includes the non-ambient sound from the recording medium." (emphasis added) 
Accordingly, this rejection should be withdrawn. 

With respect to claim 2, the prior art of record fails to teach or suggest 
the unique combination of limitations of the claimed invention, including the 
feature(s) of: "at least one of an audio regeneration device which regenerates 
non-ambient sound and a communication device which communicates with an 
external device which performs audio regeneration, wherein the image data and 
the audio regeneration data recorded in the recording medium are read out, 
and the image is displayed in accordance with the image data while 
regenerating non-ambient sound at image-capturing in accordance with the audio 
regeneration data'' (emphasis added) Accordingly, this rejection should be 
withdrawn. 

As discussed hereinabove with respect to Kobayashi et al., this rejection 
has been obviated and/ or rendered moot. Further, the Examiner's use of 
Official Notice does not meet the burden for a proper prima facie case of 
obviousness as the shortcomings of the Kobayashi et al. reference identified 
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hereinabove are not taught or suggested by the prior art of record. In addition, 
the Examiner is requested to augment the record with actual evidence to 
support the Examiner's opinions concerning Official Notice if this rejection is 
maintained in any form. 

As discussed in greater detail hereinabove, Kobayashi et al. does not 
teach or suggest the regeneration of non-ambient sound from a recording 
medium as in the claimed invention. Further, the claimed invention contains 
information relating to the location of the non-ambient sound data that is 
associated with each image. Accordingly, this rejection should be withdrawn. 

With respect to the Anderson et al. reference, as admitted by the 
Examiner, this reference is clearly not directed at the regeneration of non- 
ambient sound and/ or the storing of information relating the location of the 
non-ambient sound for each image. 

With respect to claim 3, the prior art of record fails to teach or suggest 
the unique combination of limitations of the claimed invention, including the 
feature(s) of: "regenerating non-ambient sound in accordance with audio data 
which is recorded in a first recording medium; recording image data 
representing a subject in a second recording medium at image-capturing, and 
recording, in the second recording medium, audio regeneration data which 
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indicates where the non-ambient sound is stored at the image capturing] and 
regenerating an image in accordance with the image data recorded in the 
second recording medium, and regenerating the non-ambient sound at the 
image-capturing in accordance with the audio regeneration data which is 
recorded together with the image data and also in accordance with the audio 
data which is recorded in the first recording medium. 99 (Emphasis Added) 
Accordingly, this rejection should be withdrawn. 

Applicants submit that the Kobayashi et al. does not teach or suggest the 
limitations relating to the regeneration of non-ambient sound and/or the 
storage of data indicative of where the non-ambient sound is stored for each 
image. The Examiner has pointed to element 132 (audio input) of Kobayashi et 
al. However, Applicants submit that, as identified by the Examiner, any alleged 
audio input from element 132 of Kobayashi et al. is first recorded to a memory 
card (element 102 in Kobayashi). However, no external audio regeneration 
device is relied upon for the regeneration of non-ambient sound. Accordingly, 
Kobayashi et al. clearly does not teach or suggest "regenerating the non- 
ambient sound at the image-capturing in accordance with the audio 
regeneration data which is recorded together with the image data and also in 
accordance with the audio data which is recorded in the first recording medium." 
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In accordance with the above discussion of the patents relied upon by 
the Examiner, Applicants respectfully submits that these documents, either in 
combination together or standing alone, fail to teach or suggest the invention 
as is set forth by the claims of the instant application. 

Accordingly, reconsideration and withdrawal of the claim rejection are 
respectfully requested. Moreover, Applicants respectfully submits that the 
instant application is in a condition for allowance. 

As to the dependent claims, Applicants respectfully submits that these 
claims are allowable due to their dependence upon an allowable independent 
claim, as well as for additional limitations provided by these claims. 

CONCLUSION 

Since the remaining references cited by the Examiner have not been 
utilized to reject the claims, but merely to show the state-of- the-art, no further 
comments are deemed necessary with respect thereto. 

All the stated grounds of rejection have been properly traversed and/ or 
rendered moot. Applicants therefore respectfully requests that the Examiner 
reconsider all presently pending rejections and that they be withdrawn. 
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It is believed that a full and complete response has been made to the 
Office Action, and that as such, the Examiner is respectfully requested to send 
the application to Issue. 

Applicants respectfully petition under the provisions of 37 C.F.R. § 1. 136(a) 
and § 1.17 for a two-month extension of time in which to respond to the 
Examiner's Office Action. The Extension of Time Fee in the amount of $420.00 
is attached hereto. 

In the event there are any matters remaining in this application, the 
Examiner is invited to contact Matthew T. Shanley, Registration No. 47,074 at 
(703) 205-8000 in the Washington, D.C. area. 



# 
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If necessary, the Commissioner is hereby authorized in this, concurrent, 
and future replies, to charge payment or credit any overpayment to Deposit 
Account No. 02-2448 for any additional fees required under 37 C.F.R. §§1.16 or 
1.17; particularly, extension of time fees. 

Respectfully submitted, 

BIRCH, STEWART, KOLASCH 86 BIRCH, LLP 




Marc S. Weiner 
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ELECTRONIC CAMERA AND RECORDING AND 
REGENERATING METHOD THEREIN 



BACKGROUND OF THE INVENTION 



Field of the Invention 

[00011 The present invention relates generally to an electronic camera and its 
recording and regenerating method, particularly to an electronic camera and its 
recording and regenerating method which can perform audio-regeneration and 
image-capture or image-regeneration simultaneously. 

Description of Related Art 

[00021 When regenerating an image which has been captured by an electronic 
camera for recording a still image and/or a moving image in a record recording 
medium and simultaneously regenerating sound by linking audio data of another 
audio medium corresponding with the regenerated image, the user controls the 
audio regeneration of the audio medium while looking at the displayed image. 
However, by the conventional method, the user always has to control the audio 
regeneration of the audio medium, and in such case errors may occur during 
operation. 



[00031 SUMMARY OF THE INVENTION 

[00041 The present invention has been developed in view of the above- 
described circumstances, and has as its object the provision of an electronic 
camera and its recording and regenerating method in which sound that 
corresponds with a captured image is automatically regenerated so that the image 
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and the sound can be easily appreciated simultaneously. 

[00051 In order to achieve the above-described objects, the present invention is 
directed to an electronic camera, comprising: an imaging part which captures a 
subject image; a record recording medium which records captured image data; 
and at least one of an audio regeneration device which regenerates sound and a 
communication device which communicates with an external device which 
performs audio regeneration, wherein when the subject image is captured, audio 
regeneration data which at least indicates where sound during audio regeneration 
is stored is recorded in the record recording medium together with the captured 
image data. 

[00061 According to the present invention, the audio regeneration data 
indicating at least where the sound during the audio regeneration is stored is 
recorded in the record recording medium together with the captured image data 
when image-capturing. Thus, the sound corresponding with the captured image 
can be automatically regenerated, so that the image and the sound can be easily 
appreciated simultaneously. 

[00071 Moreover, the present invention is directed to an electronic camera, 
comprising: an imaging part which captures a subject image; at least one of a 
display which displays an image in accordance with the image data recorded in 
the above-mentioned record recording medium and an image signal output 
device which externally outputs an image signal in accordance with the image 
data recorded in the above-mentioned record recording medium; and at least one 
of an audio regeneration device which regenerates sound and a communication 
device which communicates with an external device which performs audio 
regeneration, wherein the image data and the audio regeneration data recorded in 
the record recording medium are read out, and the image is displayed in 
accordance with the image data while regenerating sound at image-capturing in 
accordance with the audio regeneration data. 
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[00081 According to the present invention, the sound corresponding with the 
image can be automatically regenerated in accordance with the audio 
regeneration data which is recorded in the record recording medium; hence the 
image and the sound can be easily appreciated simultaneously. 

100091 BRIEF DESCRIPTION OF THE DRAWINGS 

[00101 The nature of this invention, as well as other objects and advantages 
thereof, will be explained in the following with reference to the accompanying 
drawings, in which like reference characters designate the same or similar parts 
throughout the figures and wherein: 

[00111 Fig. 1 is a block diagram showing an electronic camera according to an 
embodiment of the present invention; 

[00121 Fig. 2 is a flowchart showing a process for capturing an image by using 
the electronic camera and its recording and regenerating method according to an 
embodiment of the present invention; 

[00131 Fig. 3 is a flowchart showing a process for capturing an image 
considering a link with audio regeneration by using the electronic camera and its 
recording and regenerating method according to an embodiment of the present 
invention; 

[00141 Fig. 4 is a timing chart showing a process for capturing an image 
during audio regeneration and for automatically regenerating the recorded image 
while automatically regenerating sound by using the electronic camera and its 
recording and regenerating method according to an embodiment of the present 
invention; 

[00151 Fig. 5 is a flowchart showing the process for capturing the image 
during the audio regeneration and for automatically regenerating the recorded 
image while executing automatic audio regeneration by using the electronic 
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camera and its recording and regenerating method according to the embodiment 
of the present invention; 

[00161 Fig. 6 is a timing chart showing a process for capturing an image 
during audio regeneration and manually regenerating the recorded image while 
automatically regenerating sound by using the electronic camera and its 
recording and regenerating method according to an embodiment of the present 
invention; 

[0017] Fig. 7 is a flowchart showing the process for capturing the image 
during the audio regeneration and manually regenerating the recorded image 
while automatically regenerating sound by using the electronic camera and its 
recording and regenerating method according to the embodiment of the present 
invention; 

[00181 Fig. 8 is a timing chart showing a process for automatically 
regenerating a captured and recorded image considering a link with audio 
regeneration while automatically regenerating sound by using the electronic 
camera and its recording and regenerating method according to an embodiment 
of the present invention; 

[00191 Fig. 9 is a flowchart showing the process for automatically 
regenerating the captured and recorded image considering the link with the audio 
regeneration while automatically regenerating sound by using the electronic 
camera and its recording and regenerating method according to the embodiment 
of the present invention; and 

[00201 Fig. 10 is a flowchart showing the process for automatically 
regenerating the captured and recorded image considering the link with the audio 
regeneration while automatically regenerating sound by using the electronic 
camera and its recording and regenerating method according to the embodiment 
of the present invention. 
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[00211 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

[00221 Hereunder a preferred embodiment of an electronic camera and its 
recording and regenerating method of the present invention will be described in 
accordance with accompanying drawings. 

[00231 Fig. 1 is a block diagram showing an electronic camera according to an 
embodiment of the present invention. An electronic camera 8 and an audio 
regeneration device 70 as external equipment are connected to each other 
through a communication line 72 in Fig. 1 ; however, the present invention is not 
limited to this configuration and the audio regeneration device 70 can be built in 
the electronic camera 8. 

[00241 An optical system of the electronic camera 8 comprises a lens 10 which 
can adjust focus, an iris 12 for adjusting amount of light, and a solid-state 
imaging device (e.g., charge-coupled device: CCD) 14 for converting image into 
an electric signal. The image signal which is obtained by the CCD 14 goes 
through an analog process circuit and an A/D converter both of which are 
provided in an image signal processing part 16 so as to obtain digital R, Q and B 
signals. 

[00251 The CCD 14 and the image signal processing part 16 are synchronized 
and driven by a timing signal which is outputted from an imaging timing control 
part 18. The timing signal outputted from the imaging timing control part 18 can 
be changed by an instruction from a control part 22, hence a frame rate and a 
number of pixels can be set without limitations. In addition to the above- 
mentioned features, the image signal processing part 16 performs the changing a 
size of an image, sharpness correction, gamma correction, contrast correction, 
white balance correction, and so forth. 

[00261 The R, G, and B signals, outputted from the imaging signal processing 
part 16, are sequentially stored in a buffer memory 20 temporally temporarily via 
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a bus line 24. 

r00271 The control part 22 can have a TTLAE function, in which brightness 
component of an image is extracted from obtained digital signal values of an 
image, a brightness level of a subject is obtained by integrating the brightness 
component with respect to a predetermined area, and an exposure power (iris and 
shutter speed) required for image-capturing is obtained from the brightness level 
of the subject. 

[00281 In the inside of the control part 22, there are provided a RAM as a 
readable and writeable memory device (not shown) and a ROM which stores a 
program and fixed numbers that govern operations of the control part 22. 
[00291 An input unit 26 of the electronic camera 8 is provided with a shutter 
button, a function switch, a cursor key, a determining switch, an image 
regeneration button, a NEXT button, an image regeneration end button, and so 
forth, all of which are not shown, and operation data of each is transmitted to the 
control part 22. 

[00301 Audio record system of the electronic camera 8 comprises folio wings: 
microphones 28 and 28 for converting an audio signal into an electric signal, 
microphone amplifiers 30 and 30 for amplifying a feeble audio signal which is 
outputted from the microphones 28 and 28, a sampling rate generator 32 for 
producing a designated sampling rate which is instructed by the control part 22 
and for generating the sampling rate, A/D converters 34 and 34 for sampling the 
audio signal in response to the sampling rate and converting the audio signal into 
digital data, compressors 36 and 36 for reducing an amount of the digital data, 
and a multiplexor 38 for combining right and left channels of the audio data and 
transmitting the data to the bus line 24. 

[00311 The bus line 24 is provided with a compression-expansion processing 
part 40 and a recording-regenerating processing part 44. The compression- 
expansion processing part 40 compresses the image data and the audio data by a 
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method such as MJPEG and MPEG, and expands the compressed data. The 
recording-regenerating processing part 44 converts the data in order to 
record/read out the image data and the audio data to/from a record recording 
medium 42. The memory medium 42 may be a detachable memory medium 
such as a memory card and an MO. 

[00321 The electronic camera 8 is also provided with a communication signal 
processing part 46 and a communication timing control part 48. The 
communication signal processing part 46 transmits the image data and the audio 
data to external equipment through communication, and communicates with a 
connected audio regeneration device 70. The communication timing control part 
48 controls a communication speed. In Fig. 1, the electronic camera 8 and the 
audio regeneration device 70 are connected to each other through the 
communication line 72; thus exchanging of data such as audio regeneration track 
number and a regeneration time, and bi-directional communication of a 
command signal and the like are possible. Regenerated sound of the audio 
regeneration device 70 can be monitored through an audio monitor 74. 
[00331 The audio regeneration device 70 is constructed to be able to perform 
audio regeneration by operating an operation button which is provided to the 
device itself. The audio regeneration device 70 can also transfer a command via 
the communication line 72 so as to automatically regenerate data. 
f00341 In order to regenerate the image data recorded in the record recording 
medium 42, the electronic camera 8 appropriately expands the data which is read 
out by the recording-regenerating processing part 44 at the compression- 
expansion processing part 40, and converts the data at a regeneration signal 
processing part 52 into a displayable signal and into a signal form which can be 
outputted to the outside in accordance with a timing signal which is outputted 
from a regeneration timing control part 54. The converted signal is transmitted 
to a display 56 and a captured image is displayed. The electronic camera 8 may 
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output the image signal to the outside from the regeneration signal processing 
part 52 instead of displaying the image on the display 56. 

[00351 In order to regenerate the audio data which is recorded in the record 
recording medium 42, the audio regeneration device 70 appropriately expands 
the data which is read out by the recording-regenerating processing part 44 at the 
compression-expansion processing part 40, and separates the audio signals to 
respective channels at a demultiplexor 58 so as to transmit the data to data 
expansion parts 60 and 60. Each audio data which is expanded at the data 
expansion parts 60 and 60 is transmitted to D/A converters 62 and 62, and is 
converted into an analog audio signal according to the sampling rate data which 
is generated from a sampling rate generator 64. Then, the audio data is outputted 
through output terminals 68 and 68 to the external equipment after quantization 
distortion of the data is attenuated by low-pass filters 66 and 66. 
[00361 Now a description will be given on an image-capturing process of the 
electronic camera 8 which is constructed as described above. 
[00371 An image to be captured is formed on a light receiving face of the 
solid-state imaging device (CCD) 14 via the taking lens 10 and the iris 12. The 
subject image is photoelectrically converted into a charge signal at each sensor in 
the CCD 14 by an amount corresponding with an amount of an incident light. A 
timing signal is outputted from the imaging timing controller 18 whereby the 
charge signal which is accumulated in the CCD 14 is successively outputted, and 
processes such as amplifying the R, G, and B signals of the image data at the 
image signal processing part 16, decreasing noise, and converting the data into 
digital data, are performed. 

[00381 The control part 22 temporally temporarily stores the image data which 
is converted into the digital data in the buffer memory 20. The image data, 
stored in the buffer memory 20, is appropriately extracted and successively 
transferred to the regeneration signal processing part 52 then displayed on the 



• 



10 

display 56. 

[00391 In the audio record system, the feeble audio signals which are outputted 
from the microphones 28 and 28 are amplified by the microphone amplifiers 30 
and 30, and the sampling is performed on the audio signals by the predetermined 
sampling rate so as to convert the signals into digital data. The amount of the 
digital data is compressed by the data compression parts 36 and 36 and the right 
channel and the left channel of the audio data are combined by the multiplexor 
38, then the data is transmitted to the bus line 24. 

As pressing a shutter button which i s provided to the input unit 26, 
th e[00401 The electronic camera 8 is set in a mode to record the subject 
image if a shutter button which is provided to the input unit 26 is pressed by the 
user . Then the control part 22 successively records the image data which is 
temporally temporarily stored in the buffer memory 20 and the audio data which 
is obtained from the multiplexor 38. 

[00411 Fig. 2 is a flowchart showing a process for capturing an image during 
the audio regeneration by using the electronic camera and its recording and 
regenerating method according to the embodiment of the present invention. As 
the image-capturing mode is designated in the electronic camera 8, the program 
jumps to a sub routine in Fig. 2. 

r00421 In a step SI 00 "AUDIO REGENERATION" in Fig. 2, when a 
"REGENERATION BUTTON" which is provided to the audio regeneration 
device 70 is pressed, the program proceeds to SI 02 "AUDIO MANAGEMENT 
DATA", SI 04 "TRACK DATA", and SI 06 "PLAY TIME DATA". DATA." The 
program then executes reading out the audio management data such as date and 
title during regeneration, track data in which regenerating audio data is recorded, 
and play time data from the audio r e cord recording medium. 
[00431 The program then proceeds to SI 08 "AUDIO REGENERATION 
COMPLETED?", and determines whether or not completion of the audio 
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regeneration is designated. If the completion of the audio regeneration is not 
designated at SI 08, the program returns to SI 02. If the completion of the audio 
regeneration is designated, the program proceeds to SI 10 "END", and finishes 
the routine for audio regeneration, then returns to the original routine. 
[00441 When half-pressing the shutter button which is provided to the input 
unit 26 at S112 "SHUTTER HALF-PRESSED", the program proceeds to S114 
"CAPTURE IMAGE" and waits until the shutter button is fully pressed. The 
control part 22 of the electronic camera 8 starts communicating with the audio 
regeneration device 70 with respect to the communication signal processing part 
46, and executes a process to receive the audio management data such as date 
and title which are read by the audio regeneration device 70 from the audio 
record recording medium, track data in which the regenerating audio data is 
recorded, and the play time data. The received data is temporally temporarily 
stored in the memory device (RAM) which is provided in the control part 22. 
As [00451 When the shutter is fully pressed at SI 14 "CAPTURE IMAGE", 
the program proceeds to S 1 1 6 "START IMAGE DATA RECORDING", and goes 
on to a process for recording the captured image data to the record recording 
medium 42. 

[00461 At S 1 1 8 "RECORD Audio Tag 1 ", the audio management data which is 

received from the audio regeneration device 70 together with the captured image 

data is recorded to the record recording medium 42 as "Audio Tag 1". 

[00471 At SI 20 "RECORD Audio Tag 2", the track number data which is 

received from the audio regeneration device 70 together with the captured image 

data is recorded to the record recording medium 42 as "Audio Tag 2". 

[00481 At SI 22 "RECORD Audio Tag 3", the play time data which is received 

from the audio regeneration device 70 together with the captured image data is 

recorded to the r e cord recording medium 42 as "Audio Tag 3", 

[00491 At SI 24 "Audio Tag 4 = NONE", the regeneration track order data is 
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recorded together with the captured image data; however, nothing is recorded in 
the regeneration track data when the image is captured during the audio 
regeneration like the case of this embodiment. 

[00501 Next, at SI 26 "RECORD IMAGE DATA", the captured image data is 
recorded to the record recording medium 42. If the image-capturing mode is 
released, the program proceeds to the next SI 28 "END", and this image- 
capturing routine is completed. In a case where the shutter is half-pressed 
without releasing the image-capturing mode, the program returns to SI 12 and 
again prepares for image-capturing. 

[00511 Fig. 3 is a flowchart showing a process for recording an image while 
considering a link with the audio regeneration by using the electronic camera and 
its recording and regenerating method according to an embodiment of the present 
invention. When a link recording mode is designated in the electronic camera 8, 
the program jumps to the routine in Fig. 3. 

[00521 At SI 30 "MEMORY ON" in Fig. 3, a "MEMORY" switch of the audio 
regeneration device 70 is pressed, so that the audio regeneration device 70 is in a 
mode to set a tune and an order of tune to be regenerated. 

[00531 At SI 32 "SELECT TUNE AND ORDER OF TUNE", an operation 
button of the audio regeneration device 70 is operated so as to program the tune 
and the order of tune to be regenerated. 

100541 The program proceeds to SI 34 "AUDIO REGENERATION SWITCH 
ON" and SI 36 "IMAGE-CAPTURING START SWITCH ON", so that the 
regeneration switch which is provided to the audio regeneration device 70 and 
the image-capturing start switch which is provided to the electronic camera 8 are 
pressed simultaneously. 

rOOSSl An execution program for the audio regeneration device 70 proceeds to 
S138 "AUDIO MANAGEMENT DATA" and SI 40 "REGENERATION 
TRACK ORDER DATA", and executes a process to read out the audio 
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management data such as date and title during regeneration and the audio track 
order data to be regenerated. 

[00561 The program then proceeds to the next SI 42 "START AUDIO 
REGENERATION" and waits for an image-capturing start data from the 
electronic camera 8. In a case where the image-capturing start data is obtained 
from the electronic camera 8, the program proceeds to SI 46 "TRACK DATA" 
and SI 48 "PLAY TIME DATA", and executes a process to read out the track 
data to which the regenerating audio data is recorded and the play time data. 
r00571 After that, the program proceeds to SI 50 "ALL TUNES 
COMPLETED". If the audio regeneration of all tunes is completed, the program 
proceeds to SI 70 "END" and returns to the original routine after ending the 
routine for the audio regeneration. 

[00581 On the other hand, an execution program for the electronic camera 8 
proceeds to SI 52 "I = 0" when start of image-capturing is designated at SI 36. 
At SI 52, the program proceeds to SI 54 "CAPTURE IMAGE" after substituting 
0 for a variable indicating a number of recorded image or images. 
r00591 At SI 54, "I = 0?" of SI 56 is determined. It is "I = 0" if the electronic 
camera 8 is in a state before starting capturing the first frame; thus the electronic 
camera 8 instructs the audio regeneration at SI 42 of the audio regeneration 
device 70 via a communication part. If "I = 0" is not determined at SI 56, the 
electronic camera 8 instructs at SI 46 to read out the track data during 
regeneration. 

[00601 At SI 57 "I = I + 1", in response to execution of capturing the first 
frame, a calculation is performed for adding 1 to the variable indicating the 
number of recorded image(s). Then, the program proceeds to SI 58 "START 
IMAGE DATA RECORDING", and the process moves on to recording of the 
captured image data to the r e cord recording medium 42. 

100611 At SI 60 "RECORD Audio Tag 1", the audio management data, 
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received from the audio regeneration device 70, is recorded to the record 
recording medium 42 as "Audio Tag 1" together with the captured image data. 
[0062] At SI 62 "RECORD Audio Tag 2", the track number data, received 
from the audio regeneration device 70, is recorded to the record recording 
medium 42 as "Audio Tag 2" together with the captured image data. 
f00631 At SI 64 "RECORD Audio Tag 3", the audio play time data, received 
from the audio regeneration device 70, is recorded to the record recording 
medium 42 as "Audio Tag 3" together with the captured image data. 
100641 At SI 66 "RECORD Audio Tag 4", the regeneration track order data, 
received from the audio regeneration device 70, is recorded to the record 
recording medium 42 as "Audio Tag 4" together with the captured image data. 
100651 At SI 68 "RECORD IMAGE DATA", the captured image data is 
recorded to the record recording medium 42. As the image-capturing mode is 
released, the program proceeds to SI 70 "END" and finishes the image-capturing 
routine. If the shutter is half-pressed without releasing the image-capturing 
mode, the program returns to SI 54 and again prepares for image-capturing. 
100661 Fig. 4 is a timing chart showing a process for capturing an image 
during the audio regeneration, and automatically regenerating the recorded 
image while performing automatic audio regeneration by using the electronic 
camera and its recording and regenerating method according to an embodiment 
of the present invention. Fig. 5 is a flowchart showing the process. As an image 
regeneration mode is designated in the electronic camera 8, the program jumps to 
the routine in Fig. 5. 

100671 In Fig. 4, data to be recorded in an image file of "Image 1" are a title 
"ABC" in the Audio Tag 1, a track number "1" at audio regeneration in the 
Audio Tag 2, and an audio play time "1:03" in the Audio Tag 3 together with the 
image data of "Image 1". A regenerating tune order data, also recorded in the 
"Image 1", is initially recorded in the Audio Tag 4, but nothing is recorded in the 
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regeneration track data in a case where the image is captured during the audio 
regeneration. Similarly, the data mentioned above are recorded also in "Image 
2" and "Image 3" and so on following "Image 1". 

f 0068 1 As regeneration of music of "track 1" is started, the image of "Image 
1" is displayed after a predetermined background audio regeneration time ivtl. 
The image is displayed during an image display time itt, and the sound is 
simultaneously being regenerated. As the image display is completed, the audio 
regeneration of "TRACK 1" is completed after a predetermined background 
audio regeneration time ivt2, and the program moves on to the audio 
regeneration of "TRACK 3". The following regeneration of the image and 
sound are automatically performed in the same manner. 

100691 In Fig. 5, an image to be regenerated is selected at SI 80 "SELECT 
IMAGE, SELECTED NUMBER = T" while referring to a preview screen, then 
the program proceeds to SI 82 "N = 0". At SI* 2 S 182, 0 is substituted for the 
variable indicating the number of regenerated image or images. 
[0070] When pressing the regeneration switch which is provided to the audio 
regeneration device 70 at SI 86 "AUDIO REGENERATION SWITCH ON", the 
execution program of the electronic camera 8 is advanced to SI 84 
"REGENERATE SELECTED IMAGE DATA' 1 via the communication part 
which is provided between the audio regeneration device 70 and the electronic 
camera 8. 

[00711 At S 1 84, an input from the image regeneration button provided to the 
electronic camera 8 is in a stand-by state. As the image regeneration button is 
pressed, regeneration and display of the image are started and the execution 
program proceeds to SI 88 "N = N + 1", then 1 is added to the variable indicating 
the number of regenerated images. 

100721 At SI 90 "Audio Tag 1 EXISTS?", whether or not data is written in 
"Audio Tag 1" is determined. If it is determined that the data is written in 
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"Audio Tag 1" at SI 90, the program diverges to SI 92 "MEDIUM IN AUDIO 
REGENERATION DEVICE?", and the electronic camera 8 checks to the audio 
regeneration device 70 via the communication part whether or not the medium 
exists in the audio regeneration device 70. If the medium exists in the audio 
regeneration device 70, the program diverges to SI 94 "CORRESPONDENCE 
BETWEEN Audio Tag 1 AND THE AUDIO MANAGEMENT DATA", and the 
electronic camera 8 checks to the audio regeneration device 70 whether or not 
Audio Tag 1 and the audio management data correspond with each other. If 
Audio Tag 1 and the management data correspond with each other, the program 
proceeds to SI 96 "CHECK Audio Tag 2". 

[00731 If it is determined that no data is written in "Audio Tag 1 " at S 1 90, or if 
no medium exists at SI 92, or if Audio Tag 1 and the audio management data do 
not correspond with each other at SI 94, the program proceeds to S212 "LCD 
DISPLAY TIME L - 0", and executes the process to display the designated image 
data only. 

[00741 At SI 96, a track number, written in "Audio Tag 2", is read, and an 
instruction for reading out the track number which is written in "Audio Tag 2" at 
SI 98 "RETRIEVE TRACK NUMBER" is transmitted to the audio regeneration 
device 70 via the communication part. Then, the execution program of the audio 
regeneration device 70 proceeds to S200 "START AUDIO REGENERATION 
FROM Audio Tag 3 ivtl Tag 3 -ivtl ". and starts the audio regeneration. After 
that, at S202 "AUDIO REGENERATION TIME = Audio Tag 3?", when the 
audio regeneration time corresponds with the time ivtl after the start of audio 
regeneration, that is, when the audio regeneration time corresponds with "Audio 
Tag 3", an instruction for displaying the image of "Image 1" is transmitted to the 
electronic camera 8 via the communication part. 

[00751 The electronic camera 8 displays the image of "Image 1" at S214 when 
ivtl has passed after the audio regeneration device 70 starts the audio 
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regeneration. Then at S216 "L > itt ?", a process is performed for waiting until 
the image display time L is reached at or passed the itt. As the image display 
time L reaches at or passed the itt, the program proceeds to S218 "LCD NOT 
DISPLAYED", and suspends LCD display. 

[00761 The program then proceeds to determination at S204 "AUDIO 
REGENERATION TIME > Audio Tag 3 + ivtl + ivt2 ?", and waits until the 
audio regeneration time reaches at "Audio Tag 3 + ivtl + ivt2". As the audio 
regeneration time reaches at "Audio Tag 3 + ivtl + ivt2", the program proceeds 
to S206 "AUDIO REGENERATION COMPLETED", and finishes the audio 
regeneration. 

[00771 At S208 "N = T", whether or not the images are displayed by the 
number which is selected at SI 80 is determined. In a case where the images are 
displayed by the selected number (i.e., if N = T), the program proceeds to S210 
(END) to finish the subroutine. In a case where the images are not displayed by 
the selected number (i.e., if N < T), the program returns to SI 84, and repeatedly 
executes the process to sequentially perform the next audio regeneration and 
image display. 

[00781 Fig. 6 is a timing chart showing a process for capturing an image 
during audio regeneration, and manually regenerating the recorded image while 
automatically regenerating sound by using the electronic camera according to an 
embodiment of the present invention. Fig. 7 is a flowchart showing the process. 
As a mode to manually regenerate the image is designated in the electronic 
camera 8, the program jumps to the routine in Fig. 7. 

[00791 In Fig. 6, data to be recorded in the image file of "Image 1" are the title 
"ABC" in Audio Tag 1, the track number "1" at audio regeneration in Audio Tag 
2, and the audio play time "1:23" in Audio Tag 3. The regeneration tune order 
data, also recorded in "Image 1", is initially recorded in the Audio Tag 4, but 
nothing is recorded in a case where the image is captured during the audio 
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regeneration. Similarly, the data mentioned above are recorded to the image file 
of "Image 2" following "Image 1". 

[00801 As regeneration of music of "TRACK 1" is started, an image of "Image 
1" is displayed after a predetermined background audio regeneration time ivtl. 
The image is continuously displayed, and the sound simultaneously is being 
regenerated as background. The image display is completed when the user 
presses a "NEXT BUTTON" which is provided to the input unit of the electronic 
camera 8 whereby the audio regeneration and the image display of the "Image 1" 
are completed. The program moves on to the audio regeneration of the next 
"TRACK 4", and image display of "Image 2" is performed. The following 
regeneration of the image and sound is automatically performed in the same 
manner by pressing the "NEXT BUTTON". To suspend the image display, the 
user presses an "IMAGE REGENERATION COMPLETION BUTTON" which 
is provided to the input unit 26 of the electronic camera 8. 

[00811 In Fig. 7, the image regeneration switch is pressed which is provided to 
the input unit 26 of the electronic camera 8 at S220 "IMAGE REGENERATION 
SWITCH ON" and the audio regeneration switch is pressed which is provided to 
the audio regeneration device 70 at S222 "AUDIO REGENERATION SWITCH 
ON", thereby audio regeneration start data is transmitted to the electronic camera 
8 via the communication part, and the execution program of the electronic 
camera 8 proceeds to S224 "IMAGE SELECTION". 

[00821 At S224 "IMAGE SELECTION", an image to be regenerated is 
selected while referring to a preview screen, then the program proceeds to S226 
"REGENERATE SELECTED IMAGE DATA". 

[00831 At S226, an input from the image regeneration button provided to the 
electronic camera 8 is in a stand-by state. As the image regeneration button is 
pressed, regeneration and display of the image are started and the execution 
program proceeds to S228 "Audio Tag 1 EXISTS?". 
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100841 At S228 "Audio Tag 1 EXISTS?", whether or not the data is written in 
"Audio Tag 1" is determined. If it is determined that the data is written in 
"Audio Tag 1" at S228, the program diverges to S230 "MEDIUM IN AUDIO 
REGENERATION DEVICE?", and the electronic camera 8 checks via the 
communication part whether or not the medium exists in the audio regeneration 
device 70. If the medium exists in the audio regeneration device 70, the program 
diverges to S232 "CORRESPONDENCE BETWEEN Audio Tag 1 AND AUDIO 
MANAGEMENT DATA", and the electronic camera 8 checks to the audio 
regeneration device 70 whether or not Audio Tag 1 and the audio management 
data correspond with each other. If Audio Tag 1 and the management data 
correspond with each other, the program proceeds to S234 "CHECK Audio Tag 
2". 

r00851 If it is determined that no data is written in "Audio Tag 1" at S228, or if 
no medium exists at S230, or if Audio Tag 1 and the audio management data do 
not correspond with each other at S232, the program proceeds to S246 
"DISPLAY LCD", and executes the process to display the designated image data 
only. 

[00861 At S234, the track number, written in "Audio Tag 2", is read, and an 
instruction for reading out the track number which is written in "Audio Tag 2" at 
S236 "RETRIEVE TUNE OF TRACK NUMBER" is transmitted to the audio 
regeneration device 70 via the communication part. Then, the execution 
program of the audio regeneration device 70 proceeds to S238 "START AUDIO 
REGENERATION FROM Audio Tag 3-ivtl", and starts the audio regeneration. 
After that, when the audio regeneration time corresponds with the time ivtl after 
the start of audio regeneration at S240 "AUDIO REGENERATION TIME = 
Audio Tag 3?", that is, when the audio regeneration time corresponds with 
"Audio Tag 3", an instruction for displaying the image of "Image 1" is 
transmitted to the electronic camera 8 via the communication part. 
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[00871 If ivtl > 0, the electronic camera 8 displays the image of "Image 1" at 
S246 when ivtl has passed after the audio regeneration device 70 starts the audio 
regeneration. If ivtl < 0, the audio regeneration device 70 starts audio 
regeneration when ivtl has passed after displaying the image of "Image 1" at 
S246. Then at S248, a process is performed to wait until a "NEXT BUTTON" is 
pressed at S248 "NEXT BUTTON ON". If the "NEXT BUTTON" is not 
pressed, the electronic camera 8 outputs to the audio regeneration device 70 via 
the communication part an instruction to continue the audio regeneration, 
thereby a process of S242 "AUDIO REGENERATION" continues in the 
execution program of the audio regeneration device 70. 

[00881 As the "NEXT BUTTON" is pressed, the program proceeds to S250 
"LCD NOT DISPLAYED", and suspends the LCD display, then outputs to the 
audio regeneration device 70 via the communication part an instruction to finish 
the audio regeneration. In the execution program of the audio regeneration 
device 70, the process at S244 "AUDIO REGENERATION COMPLETED" is 
executed. 

[00891 At S252 "REGENERATION BUTTON OFF", whether or not the 
regeneration button is OFF is determined. If the regeneration button is not OFF 
(image regeneration is not completed), the program returns to S224 and the 
image selection is performed again. If the regeneration button is OFF (image 
regeneration is completed), the program proceeds to S254 to finish the 
subroutine. 

[00901 Fig. 8 is a timing chart showing a process for automatically 
regenerating the image captured and recorded considering a link with the audio 
regeneration while automatically regenerating sound by using the electronic 
camera and its recording and regenerating method according to an embodiment 
of the present invention. Figs. 9 and 10 are flowcharts showing the process. 
When an image regeneration mode is designated in the electronic camera 8, the 
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program jumps to the routine in Fig. 9. 

[00911 In Fig. 8, data to be recorded in an image file of "Image 1" are a title 
"ABC" in the Audio Tag 1, a track number "5" at audio regeneration in the 
Audio Tag 2, an audio play start time "0:00" in the Audio Tag 3, and 
regenerating tune order data in the Audio Tag 4 together with the image data of 
"Image 1". Similarly, the data mentioned above are recorded also in "Image 2" 
following "Image 1". 

[00921 As regeneration of background music of "track 1" is started, the image 
of "Image 1" is displayed simultaneously. The image is continuously displayed 
while the sound is regenerated at the background. The image display is 
completed at the time "3:30" of the Audio Tag 3 which is recorded in the "Image 
2". After the time "3:30", the image data of "Image 1" is substituted by "Image 
2". Afterward, regeneration of the image and sound is similarly performed 
automatically. 

[00931 In Fig. 9, the image regeneration switch which is provided to the input 
unit 26 of the electronic camera 8 is pressed at S260 "IMAGE 
REGENERATION SWITCH ON", and at the same time the audio regeneration 
switch which is provided to the audio regeneration device 70 is pressed at S262 
"AUDIO REGENERATION SWITCH ON", thereby the audio regeneration start 
data is transmitted to the electronic camera 8 via the communication part, and the 
execution program of the electronic camera 8 proceeds to S264 "IMAGE 
SELECTION". 

[00941 An image to be regenerated is selected at S264 "IMAGE 
SELECTION" while referring to a preview screen, and the program proceeds to 
S266 "Audio Tag 1 EXISTS?". 

[00951 At S266 "Audio Tag EXISTS?", whether or not data is written in 
"Audio Tag 1" is determined. If it is determined that the data is written in 
"Audio Tag 1" at S266, the program proceeds to S268 "MEDIUM IN AUDIO 
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REGENERATION DEVICE?". If no data is written in "Audio Tag 1", the 
program diverges to S274 "END" to finish the subroutine. 

[00961 At S268, the electronic camera 8 checks the communication part 
whether or not medium exists in the audio regeneration device 70. If the 
medium exists in the audio regeneration device 70, the program proceeds to 
S270 "CORRESPONDENCE BETWEEN Audio Tag 1 AND THE AUDIO 
MANAGEMENT DATA". If no medium exists in the audio regeneration device 
70, the program proceeds to the S274 "END" to finish the subroutine. 
[00971 At S270, the electronic camera 8 checks to the audio regeneration 
device 70 via the communication part whether "Audio Tag 1" and the audio 
regeneration data correspond with each other. If the "Audio Tag 1" and the audio 
regeneration data correspond with each other, the program proceeds to S272 
"Audio Tag 4 OF SELECTED IMAGE EXISTS?". If the "Audio Tag 1" and the 
audio regeneration data do not correspond with each other, the program diverges 
to S274 "END" to finish the subroutine. 

[00981 At S272, whether or not data is written in "Audio Tag 4" is determined. 
If it is determined that the data is written in "Audio Tag 4", the program proceeds 
to S276 "IMAGE SEARCH (correspondence between Tag 1 and Tag 4), 
SELECTED NUMBER = T". If it is determined that no data is written in 
"Audio Tag 4", the program diverges to S274 "END" to finish the subroutine, 
and the process at and after S246 shown in Fig. 7 is executed. 
[00991 At S276, an image in which "Tag 1" and "Tag 4" correspond with each 
other is retrieved, and all the retrieved images are determined as images to be 
regenerated. 

[01001 At S278 "SORT IN TIME ORDER OF Tag 3 BY TUNE ORDER OF 
Tag 4", images are sorted in the time order Tag 3 by the tune order Tag 4, and an 
order of tunes is set at S280 "SET TUNE ORDER FROM Audio Tag 4". 
[01011 At S280 "N = 1", a value which indicates that the first image is being 
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processed is substituted for "N", and the program proceeds to S282 "CHECK 
Audio Tag 2 OF N-TH IMAGE". 

[0102] At S282, an instruction to check the track number of the N-th image is 
outputted to the audio regeneration device 70, and the program proceeds to S284 
"CHECK Audio Tag 3 OF N-TH IMAGE". 

[01031 At S284, an instruction to check the audio regeneration time for the N- 
th image is outputted to the audio regeneration device 70. 

[01041 The program for executing control of the audio regeneration device 70 
retrieves a track number to be regenerated at S294 "RETRIEVE TUNE OF 
TRACK NUMBER". 

[01051 At S296 "AUDIO REGENERATION", the audio data of the 
designated track number is regenerated. Then at S298 "Audio Tag 2 OF N-TH 
IMAGE = TRACK NUMBER?", whether or not the designated track number is 
the track number of the N-th image is determined. If it is determined that the 
designated track number is the track number of the N-th image, the program 
proceeds to S300. If it is determined that the designated track number is not the 
track number of the N-th image, the program returns to S296. 
[01061 If it is determined at S300 "AUDIO REGENERATION TIME = Audio 
Tag 3 FOR N?" that the audio regeneration time is not equal with the 
regeneration time which is recorded in Audio Tag 3 for N, the program returns to 
S296. If the audio regeneration time reaches at an equal time with the 
regeneration time which is recorded in Audio Tag 3 for N, the program proceeds 
to S286 "LCD NOT DISPLAYED" and S302 "TUNE COMPLETED". 
[01071 In response to the determination at S300 that the audio regeneration 
time is equal with the regeneration time which is recorded in Audio Tag 3, the 
image display on the display 56 is suspended at S286. At S288 "REGENERATE 
N-TH IMAGE DATA", displaying for the next image is prepared, and image 
display is performed at S290 "DISPLAY LCD". The program proceeds to S292 
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"N = N + 1", and 1 is added to the variable "N" which indicates that the N-th 
image is processed, then the program returns to S282. 

[01081 When a tune currently regenerated at S302 is finished, the program 
returns to S294 so as to regenerate the next tune. If regeneration for all tunes is 
finished, the program proceeds to S304 "ALL TUNES COMPLETED", and 
finishes the subroutine at S306 "END". 

[01091 By the above method, the images are displayed on the LCD whenever 
Audio Tag 2 and Audio Tag 3 for the selected image correspond with the audio 
regeneration time and the track number. 

[01101 As described above, the electronic camera of the present invention 
records the audio regeneration data which at least indicates where the sound 
during the audio regeneration is stored in the record recording medium together 
with the captured image data. Therefore, the recorded image and its 
corresponding sound can be automatically regenerated, so that the image and 
sound can be easily appreciated simultaneously. 

[01111 Moreover, in another embodiment, the sound corresponding with the 
image can be automatically regenerated in accordance with the audio 
regeneration data which is recorded in the record recording medium. Therefore, 
the image and the sound can be appreciated simultaneously. 
[01121 It should be understood, however, that there is no intention to limit the 
invention to the specific forms disclosed, but on the contrary, the invention is to 
cover all modifications, alternate constructions and equivalents falling within the 
spirit and scope of the invention as expressed in the appended claims. 
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ABSTRACT OF THE DISCLOSURE 
Audio regeneration data indicating where sound during audio 
regeneration is stored is recorded in a record recording medium together with 
captured image data when image-capturing. The image data recorded in the 
record recording medium and the audio regeneration data is read during image 
regeneration process. The image is displayed in accordance with the image data 
while the sound during the image-capturing is regenerated in accordance with the 
audio regeneration data. Therefore, the image and the sound can be easily 
appreciated simultaneously and the image regeneration can be effectively 
enjoyed. 
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Field of the Invention 
[0001] The present invention relates generally to an electronic camera and its 
recording and regenerating method, particularly to an electronic camera and its 
recording and regenerating method which can perform audio-regeneration and 
image-capture or image-regeneration simultaneously. 

Description of Related Art 

[0002] When regenerating an image which has been captured by an electronic 
camera for recording a still image and/or a moving image in a recording medium 
and simultaneously regenerating sound by linking audio data of another audio 
medium corresponding with the regenerated image, the user controls the audio 
regeneration of the audio medium while looking at the displayed image. 
However, by the conventional method, the user always has to control the audio 
regeneration of the audio medium, and in such case errors may occur during 
operation. 



[0004] The present invention has been developed in view of the 
above-described circumstances, and has as its object the provision of an 
electronic camera and its recording and regenerating method in which sound that 
corresponds with a captured image is automatically regenerated so that the image 



[0003] SUMMARY OF THE INVENTION 



and the sound can be easily appreciated simultaneously. 

[0005] In order to achieve the above-described objects, the present invention is 
directed to an electronic camera, comprising: an imaging part which captures a 
subject image; a recording medium which records captured image data; and at 
least one of an audio regeneration device which regenerates sound and a 
communication device which communicates with an external device which 
performs audio regeneration, wherein when the subject image is captured, audio 
regeneration data which at least indicates where sound during audio regeneration 
is stored is recorded in the recording medium together with the captured image 
data. 

[0006] According to the present invention, the audio regeneration data 
indicating at least where the sound during the audio regeneration is stored is 
recorded in the recording medium together with the captured image data when 
image-capturing. Thus, the sound corresponding with the captured image can 
be automatically regenerated, so that the image and the sound can be easily 
appreciated simultaneously. 

[0007] Moreover, the present invention is directed to an electronic camera, 
comprising: an imaging part which captures a subject image; at least one of a 
display which displays an image in accordance with the image data recorded in 
the above-mentioned recording medium and an image signal output device 
which externally outputs an image signal in accordance with the image data 
recorded in the above-mentioned recording medium; and at least one of an audio 
regeneration device which regenerates sound and a communication device which 
communicates with an external device which performs audio regeneration, 
wherein the image data and the audio regeneration data recorded in the recording 
medium are read out, and the image is displayed in accordance with the image 
data while regenerating sound at image-capturing in accordance with the audio 
regeneration data. 



[0008] According to the present invention, the sound corresponding with the 
image can be automatically regenerated in accordance with the audio 
regeneration data which is recorded in the recording medium; hence the image 
and the sound can be easily appreciated simultaneously, 

i 

[0009] BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] The nature of this invention, as well as other objects and advantages 
thereof, will be explained in the following with reference to the accompanying 
drawings, in which like reference characters designate the same or similar parts 
throughout the figures and wherein: 

[0011] Fig. 1 is a block diagram showing an electronic camera according to an 
embodiment of the present invention; 

[0012] Fig. 2 is a flowchart showing a process for capturing an image by using 
the electronic camera and its recording and regenerating method according to an 
embodiment of the present invention; 

[0013] Fig. 3 is a flowchart showing a process for capturing an image 
considering a link with audio regeneration by using the electronic camera and its 
recording and regenerating method according to an embodiment of the present 
invention; 

[0014] Fig. 4 is a timing chart showing a process for capturing an image 
during audio regeneration and for automatically regenerating the recorded image 
while automatically regenerating sound by using the electronic camera and its 
recording and regenerating method according to an embodiment of the present 
invention; 

[0015] Fig. 5 is a flowchart showing the process for capturing the image 
during the audio regeneration and for automatically regenerating the recorded 
image while executing automatic audio regeneration by using the electronic 



camera and its recording and regenerating method according to the embodiment 
of the present invention; 

[0016] Fig. 6 is a timing chart showing a process for capturing an image 
during audio regeneration and manually regenerating the recorded image while 
automatically regenerating sound by using the electronic camera and its 
recording and regenerating method according to an embodiment of the present 
invention; 

[0017] Fig. 7 is a flowchart showing the process for capturing the image 
during the audio regeneration and manually regenerating the recorded image 
while automatically regenerating sound by using the electronic camera and its 
recording and regenerating method according to the embodiment of the present 
invention; 

[0018] Fig. 8 is a timing chart showing a process for automatically 
regenerating a captured and recorded image considering a link with audio 
regeneration while automatically regenerating sound by using the electronic 
camera and its recording and regenerating method according to an embodiment 
of the present invention; 

[0019] Fig. 9 is a flowchart showing the process for automatically 
regenerating the captured and recorded image considering the link with the audio 
regeneration while automatically regenerating sound by using the electronic 
camera and its recording and regenerating method according to the embodiment 
of the present invention; and 

[0020] Fig. 10 is a flowchart showing the process for automatically 
regenerating the captured and recorded image considering the link with the audio 
regeneration while automatically regenerating sound by using the electronic 
camera and its recording and regenerating method according to the embodiment 
of the present invention. 



[0021] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0022] Hereunder a preferred embodiment of an electronic camera and its 
recording and regenerating method of the present invention will be described in 
accordance with accompanying drawings. 

[0023] Fig. 1 is a block diagram showing an electronic camera according to an 
embodiment of the present invention. An electronic camera 8 and an audio 
regeneration device 70 as external equipment are connected to each other 
through a communication line 72 in Fig. 1 ; however, the present invention is not 
limited to this configuration and the audio regeneration device 70 can be built in 
the electronic camera 8. 

[0024] An optical system of the electronic camera 8 comprises a lens 10 which 
can adjust focus, an iris 12 for adjusting amount of light, and a solid-state 
imaging device (e.g., charge-coupled device: CCD) 14 for converting image into 
an electric signal. The image signal which is obtained by the CCD 14 goes 
through an analog process circuit and an A/D converter both of which are 
provided in an image signal processing part 16 so as to obtain digital R, Q and B 
signals. 

[0025] The CCD 14 and the image signal processing part 16 are synchronized 
and driven by a timing signal which is outputted from an imaging timing control 
part 18. The timing signal outputted from the imaging timing control part 18 
can be changed by an instruction from a control part 22, hence a frame rate and a 
number of pixels can be set without limitations. In addition to the 
above-mentioned features, the image signal processing part 16 performs the 
changing a size of an image, sharpness correction, gamma correction, contrast 
correction, white balance correction, and so forth. 

[0026] The R, Q and B signals, outputted from the imaging signal processing 
part 16, are sequentially stored in a buffer memory 20 temporarily via a bus line 



24. 

[0027] The control part 22 can have a TTLAE function, in which brightness 
component of an image is extracted from obtained digital signal values of an 
image, a brightness level of a subject is obtained by integrating the brightness 
component with respect to a predetermined area, and an exposure power (iris and 
shutter speed) required for image-capturing is obtained from the brightness level 
of the subject. 

[0028] In the inside of the control part 22, there are provided a RAM as a 
readable and writeable memory device (not shown) and a ROM which stores a 
program and fixed numbers that govern operations of the control part 22. 
[0029] An input unit 26 of the electronic camera 8 is provided with a shutter 
button, a function switch, a cursor key, a determining switch, an image 
regeneration button, a NEXT button, an image regeneration end button, and so 
forth, all of which are not shown, and operation data of each is transmitted to the 
control part 22. 

[0030] Audio record system of the electronic camera 8 comprises followings: 
microphones 28 and 28 for converting an audio signal into an electric signal, 
microphone amplifiers 30 and 30 for amplifying a feeble audio signal which is 
outputted from the microphones 28 and 28, a sampling rate generator 32 for 
producing a designated sampling rate which is instructed by the control part 22 
and for generating the sampling rate, A/D converters 34 and 34 for sampling the 
audio signal in response to the sampling rate and converting the audio signal into 
digital data, compressors 36 and 36 for reducing an amount of the digital data, 
and a multiplexor 38 for combining right and left channels of the audio data and 
transmitting the data to the bus line 24. 

[0031] The bus line 24 is provided with a compression-expansion processing 
part 40 and a recording-regenerating processing part 44. The 
compression-expansion processing part 40 compresses the image data and the 



audio data by a method such as MJPEG and MPEG, and expands the compressed 
data. The recording-regenerating processing part 44 converts the data in order 
to record/read out the image data and the audio data to/from a recording medium 
42. The memory medium 42 may be a detachable memory medium such as a 
memory card and an MO. 

[0032] The electronic camera 8 is also provided with a communication signal 
processing part 46 and a communication timing control part 48. The 
communication signal processing part 46 transmits the image data and the audio 
data to external equipment through communication, and communicates with a 
connected audio regeneration device 70. The communication timing control 
part 48 controls a communication speed. In Fig. 1, the electronic camera 8 and 
the audio regeneration device 70 are connected to each other through the 
communication line 72; thus exchanging of data such as audio regeneration track 
number and a regeneration time, and bi-directional communication of a 
command signal and the like are possible. Regenerated sound of the audio 
regeneration device 70 can be monitored through an audio monitor 74. 
[0033] The audio regeneration device 70 is constructed to be able to perform 
audio regeneration by operating an operation button which is provided to the 
device itself. The audio regeneration device 70 can also transfer a command 
via the communication line 72 so as to automatically regenerate data. 
[0034] In order to regenerate the image data recorded in the recording medium 
42, the electronic camera 8 appropriately expands the data which is read out by 
the recording-regenerating processing part 44 at the compression-expansion 
processing part 40, and converts the data at a regeneration signal processing part 
52 into a displayable signal and into a signal form which can be outputted to the 
outside in accordance with a timing signal which is outputted from a 
regeneration timing control part 54. The converted signal is transmitted to a 
display 56 and a captured image is displayed. The electronic camera 8 may 
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output the image signal to the outside from the regeneration signal processing 
part 52 instead of displaying the image on the display 56. 

[0035] In order to regenerate the audio data which is recorded in the recording 
medium 42, the audio regeneration device 70 appropriately expands the data 
which is read out by the recording-regenerating processing part 44 at the 
compression-expansion processing part 40, and separates the audio signals to 
respective channels at a demultiplexer 58 so as to transmit the data to data 
expansion parts 60 and 60. Each audio data which is expanded at the data 
expansion parts 60 and 60 is transmitted to D/A converters 62 and 62, and is 
converted into an analog audio signal according to the sampling rate data which 
is generated from a sampling rate generator 64. Then, the audio data is 
outputted through output terminals 68 and 68 to the external equipment after 
quantization distortion of the data is attenuated by low-pass filters 66 and 66. 
[0036] Now a description will be given on an image-capturing process of the 
electronic camera 8 which is constructed as described above. 
[0037] An image to be captured is formed on a light receiving face of the 
solid-state imaging device (CCD) 14 via the taking lens 10 and the iris 12. The 
subject image is photoelectrically converted into a charge signal at each sensor in 
the CCD 14 by an amount corresponding with an amount of an incident light. 
A timing signal is outputted from the imaging timing controller 18 whereby the 
charge signal which is accumulated in the CCD 14 is successively outputted, and 
processes such as amplifying the R, G, and B signals of the image data at the 
image signal processing part 16, decreasing noise, and converting the data into 
digital data, are performed. 

[0038] The control part 22 temporarily stores the image data which is 
converted into the digital data in the buffer memory 20. The image data, stored 
in the buffer memory 20, is appropriately extracted and successively transferred 
to the regeneration signal processing part 52 then displayed on the display 56. 
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[0039] In the audio record system, the feeble audio signals which are outputted 
from the microphones 28 and 28 are amplified by the microphone amplifiers 30 
and 30, and the sampling is performed on the audio signals by the predetermined 
sampling rate so as to convert the signals into digital data. The amount of the 
digital data is compressed by the data compression parts 36 and 36 and the right 
channel and the left channel of the audio data are combined by the multiplexor 
38, then the data is transmitted to the bus line 24. 

[0040] The electronic camera 8 is set in a mode to record the subject image if 
a shutter button which is provided to the input unit 26 is pressed by the user. 
Then the control part 22 successively records the image data which is 
temporarily stored in the buffer memory 20 and the audio data which is obtained 
from the multiplexor 38. 

[0041] Fig. 2 is a flowchart showing a process for capturing an image during 
the audio regeneration by using the electronic camera and its recording and 
regenerating method according to the embodiment of the present invention. As 
the image-capturing mode is designated in the electronic camera 8, the program 
jumps to a sub routine in Fig. 2. 

[0042] In a step SI 00 "AUDIO REGENERATION" in Fig. 2, when a 
"REGENERATION BUTTON" which is provided to the audio regeneration 
device 70 is pressed, the program proceeds to SI 02 "AUDIO MANAGEMENT 
DATA", SI 04 "TRACK DATA", and SI 06 "PLAY TIME DATA." The 
program then executes reading out the audio management data such as date and 
title during regeneration, track data in which regenerating audio data is recorded, 
and play time data from the audio recording medium. 

[0043] The program then proceeds to SI 08 "AUDIO REGENERATION 
COMPLETED?", and determines whether or not completion of the audio 
regeneration is designated. If the completion of the audio regeneration is not 
designated at SI 08, the program returns to SI 02. If the completion of the audio 
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regeneration is designated, the program proceeds to SI 10 "END", and finishes 
the routine for audio regeneration, then returns to the original routine. 
[0044] When half-pressing the shutter button which is provided to the input 
unit 26 at SI 12 "SHUTTER HALF-PRESSED", the program proceeds to SI 14 
"CAPTURE IMAGE 55 and waits until the shutter button is fully pressed. The 
control part 22 of the electronic camera 8 starts communicating with the audio 
regeneration device 70 with respect to the communication signal processing part 
46, and executes a process to receive the audio management data such as date 
and title which are read by the audio regeneration device 70 from the audio 
recording medium, track data in which the regenerating audio data is recorded, 
and the play time data. The received data is temporarily stored in the memory 
device (RAM) which is provided in the control part 22. 

[0045] When the shutter is fully pressed at SI 14 "CAPTURE IMAGE", the 
program proceeds to SI 16 "START IMAGE DATA RECORDING", and goes on 
to a process for recording the captured image data to the recording medium 42. 
[0046] At S 1 1 8 "RECORD Audio Tag 1 the audio management data which is 
received from the audio regeneration device 70 together with the captured image 
data is recorded to the recording medium 42 as "Audio Tag 1". 
[0047] At SI 20 "RECORD Audio Tag 2", the track number data which is 
received from the audio regeneration device 70 together with the captured image 
data is recorded to the recording medium 42 as "Audio Tag 2". 
[0048] At S122 "RECORD Audio Tag 3", the play time data which is received 
from the audio regeneration device 70 together with the captured image data is 
recorded to the recording medium 42 as "Audio Tag 3". 

[0049] At SI 24 "Audio Tag 4 = NONE", the regeneration track order data is 
recorded together with the captured image data; however, nothing is recorded in 
the regeneration track data when the image is captured during the audio 
regeneration like the case of this embodiment. 
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[0050] Next, at SI 26 "RECORD IMAGE DATA", the captured image data is 
recorded to the recording medium 42. If the image-capturing mode is released, 
the program proceeds to the next SI 28 "END", and this image-capturing routine 
is completed. In a case where the shutter is half-pressed without releasing the 
image-capturing mode, the program returns to SI 12 and again prepares for 
image-capturing. 

[0051] Fig. 3 is a flowchart showing a process for recording an image while 
considering a link with the audio regeneration by using the electronic camera and 
its recording and regenerating method according to an embodiment of the present 
invention. When a link recording mode is designated in the electronic camera 8, 
the program jumps to the routine in Fig. 3. 

[0052] At SI 30 "MEMORY ON" in Fig. 3, a "MEMORY" switch of the audio 
regeneration device 70 is pressed, so that the audio regeneration device 70 is in a 
mode to set a tune and an order of tune to be regenerated. 

[0053] At SI 32 "SELECT TUNE AND ORDER OF TUNE", an operation 
button of the audio regeneration device 70 is operated so as to program the tune 
and the order of tune to be regenerated. 

[0054] The program proceeds to SI 34 "AUDIO REGENERATION SWITCH 
ON" and SI 36 "IMAGE-CAPTURING START SWITCH ON", so that the 
regeneration switch which is provided to the audio regeneration device 70 and 
the image-capturing start switch which is provided to the electronic camera 8 are 
pressed simultaneously. 

[0055] An execution program for the audio regeneration device 70 proceeds to 
S138 "AUDIO MANAGEMENT DATA" and S140 "REGENERATION 
TRACK ORDER DATA", and executes a process to read out the audio 
management data such as date and title during regeneration and the audio track 
order data to be regenerated. 

[0056] The program then proceeds to the next SI 42 "START AUDIO 
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REGENERATION" and waits for an image-capturing start data from the 
electronic camera 8. In a case where the image-capturing start data is obtained 
from the electronic camera 8, the program proceeds to SI 46 "TRACK DATA" 
and SI 48 "PLAY TIME DATA", and executes a process to read out the track 
data to which the regenerating audio data is recorded and the play time data. 
[0057] After that, the program proceeds to SI 50 "ALL TUNES 
COMPLETED". If the audio regeneration of all tunes is completed, the 
program proceeds to SI 70 "END" and returns to the original routine after ending 
the routine for the audio regeneration. 

[0058] On the other hand, an execution program for the electronic camera 8 
proceeds to SI 52 "I = 0" when start of image-capturing is designated at SI 36. 
At SI 52, the program proceeds to SI 54 "CAPTURE IMAGE" after substituting 
0 for a variable indicating a number of recorded image or images. 
[0059] At S 1 54, "I = 0?" of S 1 56 is determined. It is "I = 0" if the electronic 
camera 8 is in a state before starting capturing the first frame; thus the electronic 
camera 8 instructs the audio regeneration at SI 42 of the audio regeneration 
device 70 via a communication part. If "I = 0" is not determined at SI 56, the 
electronic camera 8 instructs at SI 46 to read out the track data during 
regeneration. 

[0060] At SI 57 "I = I + 1", in response to execution of capturing the first 
frame, a calculation is performed for adding 1 to the variable indicating the 
number of recorded image(s). Then, the program proceeds to SI 58 "START 
IMAGE DATA RECORDING", and the process moves on to recording of the 
captured image data to the recording medium 42. 

[0061] At SI 60 "RECORD Audio Tag 1", the audio management data, 
received from the audio regeneration device 70, is recorded to the recording 
medium 42 as "Audio Tag 1" together with the captured image data. 
[0062] At SI 62 "RECORD Audio Tag 2", the track number data, received 
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from the audio regeneration device 70, is recorded to the recording medium 42 
as "Audio Tag 2" together with the captured image data. 

[0063] At SI 64 "RECORD Audio Tag 3", the audio play time data, received 
from the audio regeneration device 70, is recorded to the recording medium 42 
as "Audio Tag 3" together with the captured image data. 

[0064] At SI 66 "RECORD Audio Tag 4", the regeneration track order data, 
received from the audio regeneration device 70, is recorded to the recording 
medium 42 as "Audio Tag 4" together with the captured image data. 
[0065] At SI 68 "RECORD IMAGE DATA", the captured image data is 
recorded to the recording medium 42. As the image-capturing mode is released, 
the program proceeds to SI 70 "END" and finishes the image-capturing routine. 
If the shutter is half-pressed without releasing the image-capturing mode, the 
program returns to SI 54 and again prepares for image-capturing. 
[0066] Fig. 4 is a timing chart showing a process for capturing an image 
during the audio regeneration, and automatically regenerating the recorded 
image while performing automatic audio regeneration by using the electronic 
camera and its recording and regenerating method according to an embodiment 
of the present invention. Fig. 5 is a flowchart showing the process. As an 
image regeneration mode is designated in the electronic camera 8, the program 
jumps to the routine in Fig. 5. 

[0067] In Fig. 4, data to be recorded in an image file of "Image 1 " are a title 
"ABC" in the Audio Tag 1, a track number "1" at audio regeneration in the 
Audio Tag 2, and an audio play time "1 :03" in the Audio Tag 3 together with the 
image data of "Image 1". A regenerating tune order data, also recorded in the 
"Image 1", is initially recorded in the Audio Tag 4, but nothing is recorded in the 
regeneration track data in a case where the image is captured during the audio 
regeneration. Similarly, the data mentioned above are recorded also in "Image 
2" and "Image 3" and so on following "Image 1". 
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[0068] As regeneration of music of "track 1" is started, the image of "Image 
1" is displayed after a predetermined background audio regeneration time ivtl. 
The image is displayed during an image display time itt, and the sound is 
simultaneously being regenerated. As the image display is completed, the 
audio regeneration of "TRACK 1" is completed after a predetermined 
background audio regeneration time ivt2, and the program moves on to the audio 
regeneration of "TRACK 3". The following regeneration of the image and 
sound are automatically performed in the same manner. 

[0069] In Fig. 5, an image to be regenerated is selected at SI 80 "SELECT 
IMAGE, SELECTED NUMBER = T" while referring to a preview screen, then 
the program proceeds to SI 82 "N = 0". At S 182, 0 is substituted for the 
variable indicating the number of regenerated image or images. 
[0070] When pressing the regeneration switch which is provided to the audio 
regeneration device 70 at SI 86 "AUDIO REGENERATION SWITCH ON", the 
execution program of the electronic camera 8 is advanced to SI 84 
"REGENERATE SELECTED IMAGE DATA" via the communication part 
which is provided between the audio regeneration device 70 and the electronic 
camera 8. 

[0071] At SI 84, an input from the image regeneration button provided to the 
electronic camera 8 is in a stand-by state. As the image regeneration button is 
pressed, regeneration and display of the image are started and the execution 
program proceeds to SI 88 "N = N + 1", then 1 is added to the variable indicating 
the number of regenerated images. 

[0072] At SI 90 "Audio Tag 1 EXISTS?", whether or not data is written in 
"Audio Tag 1" is determined. If it is determined that the data is written in 
"Audio Tag 1" at SI 90, the program diverges to SI 92 "MEDIUM IN AUDIO 
REGENERATION DEVICE?", and the electronic camera 8 checks to the audio 
regeneration device 70 via the communication part whether or not the medium 
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exists in the audio regeneration device 70. If the medium exists in the audio 
regeneration device 70, the program diverges to SI 94 "CORRESPONDENCE 
BETWEEN Audio Tag 1 AND THE AUDIO MANAGEMENT DATA", and the 
electronic camera 8 checks to the audio regeneration device 70 whether or not 
Audio Tag 1 and the audio management data correspond with each other. If 
Audio Tag 1 and the management data correspond with each other, the program 
proceeds to SI 96 "CHECK Audio Tag 2". 

[0073 J If it is determined that no data is written in "Audio Tag 1" at SI 90, or if 
no medium exists at S 1 92, or if Audio Tag 1 and the audio management data do 
not correspond with each other at SI 94, the program proceeds to S212 "LCD 
DISPLAY TIME L - 0", and executes the process to display the designated image 
data only. 

[0074] At SI 96, a track number, written in "Audio Tag 2", is read, and an 
instruction for reading out the track number, which is written in "Audio Tag 2" at 
SI 98 "RETRIEVE TRACK NUMBER" is transmitted to the audio regeneration 
device 70 via the communication part. Then, the execution program of the 
audio regeneration device 70 proceeds to S200 "START AUDIO 
REGENERATION FROM Audio Tag 3-ivtl", and starts the audio regeneration. 
After that, at S202 "AUDIO REGENERATION TIME = Audio Tag 3?", when 
the audio regeneration time corresponds with the time ivtl after the start of audio 
regeneration, that is, when the audio regeneration time corresponds with "Audio 
Tag 3", an instruction for displaying the image of "Image 1" is transmitted to the 
electronic camera 8 via the communication part. 

[0075] The electronic camera 8 displays the image of "Image 1" at S214 when 
ivtl has passed after the audio regeneration device 70 starts the audio 
regeneration. Then at S216 "L > itt ?", a process is performed for waiting until 
the image display time L is reached at or passed the itt. As the image display 
time L reaches at or passed the itt, the program proceeds to S218 "LCD NOT 
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DISPLAYED", and suspends LCD display. 

[0076] The program then proceeds to determination at S204 "AUDIO 
REGENERATION TIME > Audio Tag 3 + ivtl + ivt2 ?", and waits until the 
audio regeneration time reaches at "Audio Tag 3 + ivtl + ivt2". As the audio 
regeneration time reaches at "Audio Tag 3 + ivtl + ivt2", the program proceeds 
to S206 "AUDIO REGENERATION COMPLETED", and finishes the audio 
regeneration. 

[0077] At S208 "N = T", whether or not the images are displayed by the 
number which is selected at S 180 is determined. In a case where the images are 
displayed by the selected number (i.e., if N = T), the program proceeds to S210 
(END) to finish the subroutine. In a case where the images are not displayed by 
the selected number (i.e., if N < T), the program returns to SI 84, and repeatedly 
executes the process to sequentially perform the next audio regeneration and 
image display. 

[0078] Fig. 6 is a timing chart showing a process for capturing an image 
during audio regeneration, and manually regenerating the recorded image while 
automatically regenerating sound by using the electronic camera according to an 
embodiment of the present invention. Fig. 7 is a flowchart showing the process. 
As a mode to manually regenerate the image is designated in the electronic 
camera 8, the program jumps to the routine in Fig. 7. 

[0079] In Fig. 6, data to be recorded in the image file of "Image 1 " are the title 
"ABC" in Audio Tag 1, the track number "1" at audio regeneration in Audio Tag 
2, and the audio play time "1:23" in Audio Tag 3. The regeneration tune order 
data, also recorded in "Image 1", is initially recorded in the Audio Tag 4, but 
nothing is recorded in a case where the image is captured during the audio 
regeneration. Similarly, the data mentioned above are recorded to the image 
file of "Image 2" following "Image 1". 

[0080] As regeneration of music of "TRACK 1" is started, an image of "Image 
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1" is displayed after a predetermined background audio regeneration time ivtl. 
The image is continuously displayed, and the sound simultaneously is being 
regenerated as background. The image display is completed when the user 
presses a "NEXT BUTTON'' which is provided to the input unit of the electronic 
camera 8 whereby the audio regeneration and the image display of the "Image 1" 
are completed. The program moves on to the audio regeneration of the next 
"TRACK 4", and image display of "Image 2" is performed. The following 
regeneration of the image and sound is automatically performed in the same 
manner by pressing the "NEXT BUTTON". To suspend the image display, the 
user presses an "IMAGE REGENERATION COMPLETION BUTTON" which 
is provided to the input unit 26 of the electronic camera 8. 

[0081] In Fig. 7, the image regeneration switch is pressed which is provided to 
the input unit 26 of the electronic camera 8 at S220 "IMAGE REGENERATION 
SWITCH ON" and the audio regeneration switch is pressed which is provided to 
the audio regeneration device 70 at S222 "AUDIO REGENERATION SWITCH 
ON", thereby audio regeneration start data is transmitted to the electronic camera 
8 via the communication part, and the execution program of the electronic 
camera 8 proceeds to S224 "IMAGE SELECTION". 

[0082] At S224 "IMAGE SELECTION", an image to be regenerated is 
selected while referring to a preview screen, then the program proceeds to S226 
"REGENERATE SELECTED IMAGE DATA". 

[0083] At S226, an input from the image regeneration button provided to the 
electronic camera 8 is in a stand-by state. As the image regeneration button is 
pressed, regeneration and display of the image are started and the execution 
program proceeds to S228 "Audio Tag 1 EXISTS?". 

[0084] At S228 "Audio Tag 1 EXISTS?", whether or not the data is written in 
"Audio Tag 1" is determined. If it is determined that the data is written in 
"Audio Tag 1" at S228, the program diverges to S230 "MEDIUM IN AUDIO 
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REGENERATION DEVICE?", and the electronic camera 8 checks via the 
communication part whether or not the medium exists in the audio regeneration 
device 70. If the medium exists in the audio regeneration device 70, the 
program diverges to S232 "CORRESPONDENCE BETWEEN Audio Tag 1 
AND AUDIO MANAGEMENT DATA", and the electronic camera 8 checks to 
the audio regeneration device 70 whether or not Audio Tag 1 and the audio 
management data correspond with each other. If Audio Tag 1 and the 
management data correspond with each other, the program proceeds to S234 
"CHECK Audio Tag 2". 

[0085] If it is determined that no data is written in "Audio Tag 1" at S228, or if 
no medium exists at S230, or if Audio Tag 1 and the audio management data do 
not correspond with each other at S232, the program proceeds to S246 
"DISPLAY LCD", and executes the process to display the designated image data 
only. 

[0086] At S234, the track number, written in "Audio Tag 2", is read, and an 
instruction for reading out the track number which is written in "Audio Tag 2" at 
S236 "RETRIEVE TUNE OF TRACK NUMBER" is transmitted to the audio 
regeneration device 70 via the communication part. Then, the execution 
program of the audio regeneration device 70 proceeds to S238 "START AUDIO 
REGENERATION FROM Audio Tag 3-ivtl", and starts the audio regeneration. 
After that, when the audio regeneration time corresponds with the time ivtl after 
the start of audio regeneration at S240 "AUDIO REGENERATION TIME = 
Audio Tag 3?", that is, when the audio regeneration time corresponds with 
"Audio Tag 3", an instruction for displaying the image of "Image 1" is 
transmitted to the electronic camera 8 via the communication part. 
[0087] If ivtl > 0, the electronic camera 8 displays the image of "Image 1" at 
S246 when ivtl has passed after the audio regeneration device 70 starts the audio 
regeneration. If ivtl < 0, the audio regeneration device 70 starts audio 
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regeneration when ivtl has passed after displaying the image of "Image 1" at 
S246. Then at S248, a process is performed to wait until a "NEXT BUTTON" 
is pressed at S248 "NEXT BUTTON ON". If the "NEXT BUTTON" is not 
pressed, the electronic camera 8 outputs to the audio regeneration device 70 via 
the communication part an instruction to continue the audio regeneration, 
thereby a process of S242 "AUDIO REGENERATION" continues in the 
execution program of the audio regeneration device 70. 

[0088] As the "NEXT BUTTON" is pressed, the program proceeds to S250 
"LCD NOT DISPLAYED", and suspends the LCD display, then outputs to the 
audio regeneration device 70 via the communication part an instruction to finish 
the audio regeneration. In the execution program of the audio regeneration 
device 70, the process at S244 "AUDIO REGENERATION COMPLETED" is 
executed. 

[0089] At S252 "REGENERATION BUTTON OFF", whether or not the 
regeneration button is OFF is determined. If the regeneration button is not OFF 
(image regeneration is not completed), the program returns to S224 and the 
image selection is performed again. If the regeneration button is OFF (image 
regeneration is completed), the program proceeds to S254 to finish the 
subroutine. 

[0090] Fig. 8 is a timing chart showing a process for automatically 
regenerating the image captured and recorded considering a link with the audio 
regeneration while automatically regenerating sound by using the electronic 
camera and its recording and regenerating method according to an embodiment 
of the present invention. Figs. 9 and 10 are flowcharts showing the process. 
When an image regeneration mode is designated in the electronic camera 8, the 
program jumps to the routine in Fig. 9. 

[0091] In Fig. 8, data to be recorded in an image file of "Image 1" are a title 
"ABC" in the Audio Tag 1, a track number "5" at audio regeneration in the 



20 



Audio Tag 2, an audio play start time "0:00" in the Audio Tag 3, and 
regenerating tune order data in the Audio Tag 4 together with the image data of 
"Image 1". Similarly, the data mentioned above are recorded also in "Image 2" 
following "Image 1". 

[0092] As regeneration of background music of "track 1" is started, the image 
of "Image 1" is displayed simultaneously. The image is continuously displayed 
while the sound is regenerated at the background. The image display is 
completed at the time "3:30" of the Audio Tag 3 which is recorded in the "Image 
2". After the time "3:30", the image data of "Image 1" is substituted by "Image 
2". Afterward, regeneration of the image and sound is similarly performed 
automatically. 

[0093J In Fig. 9, the image regeneration switch which is provided to the input 
unit 26 of the electronic camera 8 is pressed at S260 "IMAGE 
REGENERATION SWITCH ON", and at the same time the audio regeneration 
switch which is provided to the audio regeneration device 70 is pressed at S262 
"AUDIO REGENERATION SWITCH ON", thereby the audio regeneration start 
data is transmitted to the electronic camera 8 via the communication part, and the 
execution program of the electronic camera 8 proceeds to S264 "IMAGE 
SELECTION". 

[0094] An image to be regenerated is selected at S264 "IMAGE 
SELECTION" while referring to a preview screen, and the program proceeds to 
S266 "Audio Tag 1 EXISTS?". 

[0095] At S266 "Audio Tag EXISTS?", whether or not data is written in 
"Audio Tag 1" is determined. If it is determined that the data is written in 
"Audio Tag 1" at S266, the program proceeds to S268 "MEDIUM IN AUDIO 
REGENERATION DEVICE?". If no data is written in "Audio Tag 1", the 
program diverges to S274 "END" to finish the subroutine. 
[0096] At S268, the electronic camera 8 checks the communication part 
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whether or not medium exists in the audio regeneration device 70. If the 
medium exists in the audio regeneration device 70, the program proceeds to 
S270 "CORRESPONDENCE BETWEEN Audio Tag 1 AND THE AUDIO 
MANAGEMENT DATA". If no medium exists in the audio regeneration 
device 70, the program proceeds to the S274 "END" to finish the subroutine. 
[0097] At S270, the electronic camera 8 checks to the audio regeneration 
device 70 via the communication part whether "Audio Tag 1" and the audio 
regeneration data correspond with each other. If the "Audio Tag 1" and the 
audio regeneration data correspond with each other, the program proceeds to 
S272 "Audio Tag 4 OF SELECTED IMAGE EXISTS?". If the "Audio Tag 1" 
and the audio regeneration data do not correspond with each other, the program 
diverges to S274 "END" to finish the subroutine. 

[0098] At S272, whether or not data is written in "Audio Tag 4" is determined. 
If it is determined that the data is written in "Audio Tag 4", the program proceeds 
to S276 "IMAGE SEARCH (correspondence between Tag 1 and Tag 4), 
SELECTED NUMBER = T". If it is determined that no data is written in 
"Audio Tag 4", the program diverges to S274 "END" to finish the subroutine, 
and the process at and after S246 shown in Fig. 7 is executed. 
[0099] At S276, an image in which "Tag 1" and "Tag 4" correspond with each 
other is retrieved, and all the retrieved images are determined as images to be 
regenerated. 

[0100] At S278 "SORT IN TIME ORDER OF Tag 3 BY TUNE ORDER OF 
Tag 4", images are sorted in the time order Tag 3 by the tune order Tag 4, and an 
order of tunes is set at S280 "SET TUNE ORDER FROM Audio Tag 4". 
[0101] At S280 "N = 1", a value which indicates that the first image is being 
processed is substituted for "N", and the program proceeds to S282 "CHECK 
Audio Tag 2 OF N-TH IMAGE". 

[0102] At S282, an instruction to check the track number of the N-th image is 
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outputted to the audio regeneration device 70, and the program proceeds to S284 
"CHECK Audio Tag 3 OF N-TH IMAGE". 

[0103] At S284, an instruction to check the audio regeneration time for the 
N-th image is outputted to the audio regeneration device 70. 
[0104] The program for executing control of the audio regeneration device 70 
retrieves a track number to be regenerated at S294 "RETRIEVE TUNE OF 
TRACK NUMBER". 

[0105] At S296 "AUDIO REGENERATION", the audio data of the 
designated track number is regenerated. Then at S298 "Audio Tag 2 OF N-TH 
IMAGE = TRACK NUMBER?", whether or not the designated track number is 
the track number of the N-th image is determined. If it is determined that the 
designated track number is the track number of the N-th image, the program 
proceeds to S300. If it is determined that the designated track number is not the 
track number of the N-th image, the program returns to S296. 
[0106] If it is determined at S300 "AUDIO REGENERATION TIME = Audio 
Tag 3 FOR N?" that the audio regeneration time is not equal with the 
regeneration time which is recorded in Audio Tag 3 for N, the program returns to 
S296. If the audio regeneration time reaches at an equal time with the 
regeneration time which is recorded in Audio Tag 3 for N, the program proceeds 
to S286 "LCD NOT DISPLAYED" and S302 "TUNE COMPLETED". 
[0107] In response to the determination at S300 that the audio regeneration 
time is equal with the regeneration time which is recorded in Audio Tag 3, the 
image display on the display 56 is suspended at S286. At S288 
"REGENERATE N-TH IMAGE DATA", displaying for the next image is 
prepared, and image display is performed at S290 "DISPLAY LCD". The 
program proceeds to S292 "N = N + 1", and 1 is added to the variable "N" which 
indicates that the N-th image is processed, then the program returns to S282. 
[0108] When a tune currently regenerated at S302 is finished, the program 
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returns to S294 so as to regenerate the next tune. If regeneration for all tunes is 
finished, the program proceeds to S304 "ALL TUNES COMPLETED", and 
finishes the subroutine at S306 "END". 

[0109] By the above method, the images are displayed on the LCD whenever 
Audio Tag 2 and Audio Tag 3 for the selected image correspond with the audio 
regeneration time and the track number. 

[0110] As described above, the electronic camera of the present invention 
records the audio regeneration data which at least indicates where the sound 
during the audio regeneration is stored in the recording medium together with the 
captured image data. Therefore, the recorded image and its corresponding 
sound can be automatically regenerated, so that the image and sound can be 
easily appreciated simultaneously. 

[0111] Moreover, in another embodiment, the sound corresponding with the 
image can be automatically regenerated in accordance with the audio 
regeneration data which is recorded in the recording medium. Therefore, the 
image and the sound can be appreciated simultaneously. 

[0112] It should be understood, however, that there is no intention to limit the 
invention to the specific forms disclosed, but on the contrary, the invention is to 
cover all modifications, alternate constructions and equivalents falling within the 
spirit and scope of the invention as expressed in the appended claims. 



24 



ABSTRACT OF THE DISCLOSURE 
Audio regeneration data indicating where sound during audio 
regeneration is stored is recorded in a recording medium together with captured 
image data when image-capturing. The image data recorded in the recording 
medium and the audio regeneration data is read during image regeneration 
process. The image is displayed in accordance with the image data while the 
sound during the image-capturing is regenerated in accordance with the audio 
regeneration data. Therefore, the image and the sound can be easily 
appreciated simultaneously and the image regeneration can be effectively 
enjoyed. 



